The compositional construction of Markov processes
نویسندگان
چکیده
The idea of this paper is to introduce into the algebra of automata introduced in [4] probabilities on the actions. This permits a compositional description of probabilistic processes, in particular of Markov chains, and for this reason we call the automata we introduce Markov automata. We define a Markov automaton with a given set A of “signals on the left interface”, and set B of “signals on the right interface” to consist of a Markov matrix Q (whose rows and columns are the states) which is the sum
منابع مشابه
From Concurrency Models to Numbers - Performance and Dependability
Discrete-state Markov processes are very common models used for performance and dependability evaluation of, for example, distributed information and communication systems. Over the last fifteen years, compositional model construction and model checking algorithms have been studied for these processes, and variations thereof, especially processes incorporating nondeterministic choices. In this ...
متن کاملOn $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes
In the present paper we investigate the $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes with general state spaces. We provide a necessary and sufficient condition for such processes to satisfy the $L_1$-weak ergodicity. Moreover, we apply the obtained results to establish $L_1$-weak ergodicity of quadratic stochastic processes.
متن کاملON THE GENERALIZATION OF N-PLE MARKOV PROCESSES
The notion of N-ple Markov process is defined in a quite general framework and it is shown that N-ple Markov processes-arel inear combinationso f some martingales
متن کاملApplication of Markov Processes to the Machine Delays Analysis
Production and non-productive equipment and personnel delays are a critical element of any production system. The frequency and length of delays impact heavily on the production and economic efficiency of these systems. Machining processes in wood industry are particularly vulnerable to productive and non-productive delays. Whereas, traditional manufacturing industries usually operate on homoge...
متن کامل